Public deactivation of autonomous vehicles

ABSTRACT

Using an imaging device of a user device associated with a public user, an image of an autonomous vehicle (AV) operating in an area is captured. The public user associated with the user device is other than an occupant or controller of the AV. Image processing of the image is performed to extract a set of visual characteristics of the AV. A visual characteristic in the set of visual characteristics is insufficient to uniquely identify the AV. From a set of AVs a subset of candidate AVs is selected where each candidate AV in the subset of candidate AVs matches within a tolerance at least one visual characteristic in the set of visual characteristics, the subset of candidate AVs including the AV. A stop command is sent to the AV, causing the AV to execute a stopping operation resulting in a change in a velocity of the AV.

TECHNICAL FIELD

The present invention relates generally to a method, system, andcomputer program product for managing autonomous vehicles. Moreparticularly, the present invention relates to a method, system, andcomputer program product for public user deactivation of autonomousvehicles.

BACKGROUND

Hereinafter, an autonomous vehicle (AV) includes any ambulatory machinethat can set itself in motion to travel from one geographical point toanother point (auto-propulsion) on surface, in air, or through water.Examples of AV include but are not limited to self-driving automobiles,ambulatory robotic entities, self-propelled drones, and many othermanifestations. A reference to a vehicle herein is a reference to an AVunless expressly disambiguated where used.

Some AVs, such as self-driving automobiles, have a built-in mechanismfor stopping the motion of the AV. Generally, such stopping mechanismsare installed within the AV itself, within reach of an occupant of theAV. The occupant can activate the stopping mechanism from within the AVto cause the AV to stop the auto-propulsion of the AV. Such mechanismsare designed to allow an occupant to override, take-over, or cancel themotion of the AV under circumstances evaluated by the occupant as unsafeor unreliable for auto-propulsion. Such mechanisms are not available toa non-occupant of the AV.

Some other AVs, such as self-propelling drones and otherradio-controlled toys or AVs can be remotely controlled by a user notoccupying the AV. However, such control—including causing theauto-propulsion of the AV to stop—is a dedicated function of acontroller unit in possession of the user. Other users or othercontrollers are unable to control the AV without special configuration,such as matching a frequency on which the controls are being transmittedand received by the AV.

SUMMARY

The illustrative embodiments provide a method, system, and computerprogram product. An embodiment includes a method that captures using animaging device of a user device associated with a public user, an imageof an AV operating in an area, wherein the public user associated withthe user device is other than an occupant or controller of the AV. Theembodiment performs image processing of the image of the AV to extract aset of visual characteristics of the AV, wherein a visual characteristicin the set of visual characteristics is insufficient to uniquelyidentify the AV. The embodiment selects from a set of AVs a subset ofcandidate AVs, wherein each candidate AV in the subset of candidate AVsmatches within a tolerance at least one visual characteristic in the setof visual characteristics, the subset of candidate AVs including the AV.The embodiment sends a stop command to the AV, the sending causing theAV to execute a stopping operation resulting in a change in a velocityof the AV.

An embodiment includes a computer usable program product. The computerusable program product includes one or more computer-readable storagedevices, and program instructions stored on at least one of the one ormore storage devices.

An embodiment includes a computer system. The computer system includesone or more processors, one or more computer-readable memories, and oneor more computer-readable storage devices, and program instructionsstored on at least one of the one or more storage devices for executionby at least one of the one or more processors via at least one of theone or more memories.

BRIEF DESCRIPTION OF THE DRAWINGS

Certain novel features believed characteristic of the invention are setforth in the appended claims. The invention itself, however, as well asa preferred mode of use, further objectives and advantages thereof, willbest be understood by reference to the following detailed description ofthe illustrative embodiments when read in conjunction with theaccompanying drawings, wherein:

FIG. 1 depicts a block diagram of a network of data processing systemsin which illustrative embodiments may be implemented;

FIG. 2 depicts a block diagram of a data processing system in whichillustrative embodiments may be implemented;

FIG. 3 depicts a block diagram of an example configuration for publicdeactivation of autonomous vehicles in accordance with an illustrativeembodiment;

FIG. 4 depicts another example configuration for public deactivation ofautonomous vehicles in accordance with an illustrative embodiment;

FIG. 5 depicts one example configuration of an application for publicdeactivation of autonomous vehicles in accordance with an illustrativeembodiment;

FIG. 6 depicts another example configuration of an application forpublic deactivation of autonomous vehicles in accordance with anillustrative embodiment; and

FIG. 7 depicts a flowchart of an example process for public deactivationof autonomous vehicles in accordance with an illustrative embodiment.

DETAILED DESCRIPTION

The illustrative embodiments recognize that there can be circumstanceswhen a member of the public user—not an occupant of an AV, or a useroperating a designated controller of an AV, or a user or controllerspecifically configured to control an AV—may have to control anauto-propulsion of an AV. Specifically, the member of the public usermay have to bring the auto-propulsion of the AV to a stop in a safe andgraceful manner. A member of the public user is hereinafterinterchangeably referred to as a public user.

Some example circumstances where public user control of an AV isdesirable include, but are not limited to—a malfunctioning AV without anoccupant and out of range or non-responsive to a controller; an AV withan incapacitated occupant; self-driving car type AV malfunctioninginside a garage and ramming the walls or garage door; an AV involved inan accident where someone is pinned by the AV; and many others. Theillustrative embodiments recognize that to address these and many othercircumstances, a system should be Available by which a member of thepublic user—such as a bystander, an observer, or a witness of suchoperations of an AV—can cause a cessation of an undesirableauto-propulsion of the AV.

The illustrative embodiments recognize that the presently availabletools or solutions do not address these needs/problems or provideadequate solutions for these needs/problems. The illustrativeembodiments used to describe the invention generally address and solvethe above-described problems and other related problems by public userdeactivation of autonomous vehicles.

An embodiment can be implemented as a software application. Theapplication implementing an embodiment, or one or more componentsthereof, can be configured as a modification of an existing userdevice—i.e., a native application in the user device, as an applicationexecuting in a data processing system communicating with an existinguser device over a short-range radio network such as Bluetooth, over awired or wireline local area network (LAN)—i.e., a local application onthe LAN, as an application executing in a data processing systemcommunicating with an existing user device over a wide area network(WAN)—i.e., a remote application on the WAN, as a separate applicationthat operates in conjunction with an existing user device incollaboration with an application on the user device, a standaloneapplication, or some combination thereof.

A user device is any device physically accessible to a public user, thedevice being capable of (i) ascertaining its own geographical location,(ii) capturing an image of objects, (iii) data communications, and (iv)at least some data computing capability. Some non-limiting examples ofdevices that qualify as a user device include a smartphone, a tabletcomputer, camera equipped wearable devices, and the like. A referenceherein to a device is reference to a user device unless expresslydistinguished where used.

Within the scope of the illustrative embodiments, the stoppingoperation, or the cessation of the auto-propulsion, can, but need notnecessarily, cause the AV to come to a stand-still. The stoppingoperation can also reduce a speed of the AV, change a direction of theAV, cause a sequence of operations to occur at the AV that includes achange in the velocity of the AV. Some stopping operations may cause theAV to continue auto-propulsion until a safe time or place is reached forreduction in the speed of the AV, allowing egress from the AV, allowingphysical access to the AV or inside the AV, or some combination of theseand other similarly purposed operations.

Certain embodiments are described as operating in a combination of auser device, where the user device operates as a client, and a serverdata processing system. While such configuration is possible andcontemplated, such a configuration is not necessary for the operation ofan embodiment. An embodiment can be adapted as an entirely client-sideapplication operating only in the user device where a database describedherein is reachable from the user device, an entirely server-sideapplication operating using a server data processing system where a userdevice-mounted imaging apparatus (e.g., a camera) is accessible to theserver.

Certain assumptions are made for the correct configuration and operationof the illustrative embodiments. First assumption—a public user, andmore particularly an imaging apparatus of a user device associated withthe public user, can visually observe an AV on which the public userwishes to perform a stopping operation. Second assumption—the locationinformation provided to communicate the location of the user device isnot spoofed, masqueraded, blocked or otherwise altered to indicate alocation other than where the user device is actually present at thetime of capturing an image described herein. Third assumption—a databaseof operational AVs, or a repository of a suitable type adapted for asimilar purpose, exists and includes accurate and sufficient informationto (i) uniquely identify an AV using one or more characteristics of theAV, and (ii) locate the AV at any given time.

The characteristics of an AV contemplated herein are characteristicsthat are visually perceivable, such as by an imaging apparatus of a userdevice, and are usable in identifying the AV. The characteristic neednot be usable to uniquely identify the AV, i.e., the characteristics ofAVs are not limited to a unique identifier of the AV, e.g., a licenseplate number of an autonomous car. Some other examples of visualcharacteristics of AVs include a color, a shape, a size, a number ofappendages, a type of an appendage, a style, a model, a make, a surfacefeature, a transparency or opacity, a marking present on a surface ofthe AV or a portion thereof.

An embodiment captures a visual image of an AV on which a public userintends to execute a stopping operation. For example, the public usermay use a camera in a smartphone to take a picture of an autonomous cartraveling on a street. The embodiment also captures a location fromwhich the image is captured. For example, the location can be GlobalPositioning System (GPS) coordinates of the user device or imagingapparatus that has been used to capture the image.

One embodiment transmits the image and the location information toanother application, e.g., to an embodiment executing in a server dataprocessing system across a data network, and the embodiment in theserver processes the image and the location as described herein. Anotherembodiment processes the image and the location at the user device in amanner described herein.

It is possible that an image may be captured accidentally, hastily, orin jest, and the public user either does not intend to perform thestopping operation on the AV or decides not to perform the stoppingoperation after deliberately capturing the image. To handle such cases,an embodiment implements an accidental activation prevention mechanism.The accidental activation prevention mechanism operates to allow thepublic user an opportunity to decide whether the public user indeedwishes to perform the stopping operation on the AV.

The accidental activation prevention mechanism can take any formsuitable for a given implementation. For example, a button image thatthe public user has to click to send the image and the locationinformation may require additional steps before the button can bepressed. As another example, the button may be obscured until the userhas performed another action, such as swiping a touchscreen to lift acover graphic from the button. The cover graphic may have a viscositycharacteristic which requires a certain force or speed to be applied tothe swipe for the cover graphic to expose the button. The cover graphicmay expose the button at a certain rate where the rate is configured togive the public user a determined amount of time before the public usercan press the button. A pop-up confirmation question may be presented tothe public user before the public user can transmit the information. ACAPTCHA (Completely Automated Public Turing test to tell Computers andHumans Apart) code may be activated before the transmission.

These examples of accidental activation prevention mechanism are notintended to be limiting. From this disclosure, those of ordinary skillin the art will be able to conceive many other accidental activationprevention mechanisms to prevent or delay a public user fromaccidentally or unintentionally activating a stopping operation on anAV, and the same are contemplated within the scope of the illustrativeembodiments.

An embodiment uses the image and the location information to identifythe AV. The embodiment performs image processing using a known imageprocessing and recognition technique to identify one or more visualcharacteristics of the AV in the image. The embodiment uses a databaseof operational AVs to identify the AV in question. Particularly, theembodiment queries the database to obtain a set of AVs operating withina specified radius from the location, and having one or more visualcharacteristics extracted from the image. The area need not necessarilybe defined as a circle of a radius. Other manners of specifying an arearelative to a location—such as a set of coordinates defining a polygonthat encloses the location—can be used in a similar manner.

In one implementation, such an embodiment may execute on a server andperform the image processing, accessing the database, and querying andobtaining the result set at or from the server. In anotherimplementation, such an embodiment may execute on the user device, andperform the image processing, accessing the database, and querying andobtaining the result set at or from the user device.

The set of AVs returned by the database includes those AVs that are orwere operating in the given radius from the supplied location, and wereidentifiable using at least one supplied visual characteristic extractedfrom the captured image. From the set of AVs, several actions arepossible. One embodiment can trigger a stopping operation on all the AVsreturned in the result set. Another embodiment can perform a secondlevel of analysis to narrow the set of AVs to a subset of candidate AVs.

One embodiment presents the set of AVs to the public user and asks thepublic user to identify the particular AV on which the stoppingoperation should be performed. Another embodiment selects a most likelycandidate AV from the set using an additional visual characteristicextracted from the captured image. Another embodiment may use a map orknowledge of the area within the radius to exclude those AVs from theset which would be visually obscured from the public user, e.g., by abuilding, a blind turn, or other obstruction. An embodiment can combinemore than one of these and other similarly purposed techniques to reducethe set of AVs to a subset of candidate AVs. In one case, the subsetincludes only one candidate AV.

Before a stopping operation can be performed on one or more candidateAVs, an embodiment performs further checks to ensure that the publicuser is not misusing or maliciously using the stopping operation on acandidate AV. It is possible that in a genuine circumstance thatwarrants the stopping operation, more than one public users will requestthe stopping operation by sending images of the AV and their locations.One embodiment correlates one public user's request data with anotherpublic user's request data. For example, the embodiment may determinethat for a genuine circumstance, locations of two or more public usersare within a threshold distance from one another, the images captured bytwo or more public users include a common AV, or both.

Another embodiment can verify that a circumstance for a stoppingoperation exist using other types of data. For example, a lawenforcement source may also provide data of an incident involving an AVin the image from a public user within a threshold distance from thelocation of the public user. Other external sources, such as a newssource, a social media platform, or a crowd-sourced repository may alsoprovide similar data. The embodiment corroborates the public user'srequest for stopping operation on an AV using such law enforcement data,news data, social media data, crowd-sourced data, and other similarlyusable external data.

The stopping operation can be performed on an AV by sending a stopcommand to the AV. A system in the AV is configured to execute thestopping operation upon receiving the stop command. The stop command cantake many suitable forms. For example, in one case, the stop commandcomprises command instruction transmitted to the AV in a datatransmission, which the AV is capable of receiving wirelessly.

In another case, the stop command comprises command instructiontransmitted to the AV in a wavelength band of the electromagnetic wavespectrum, which the AV is capable of receiving. As some non-limitingexamples, the transmission may be in visible wavelengths, infraredwavelengths, ultraviolet wavelengths, or microwave wavelengths.

In another case, the stop command comprises command instructiontransmitted to the AV in a sonic frequency band, which the AV is capableof receiving. As some non-limiting examples, the transmission may be inhuman-audible, infra-human-audible, or ultra-human-audible frequencies.

More than one AVs can be present in the set of AVs returned from thedatabase, or in a reduced subset of AVs computed from the returned set.Each AV in such a set or subset has a likelihood of being the AV onwhich the user intended to apply the stopping operation. When a stoppingoperation is to be applied to more than one AV, an embodiment causes thestopping operation to be applied to AVs in the set or the reduced subsetin a descending order of the likelihood. If the stopping operation isaccomplished using a signal from the user's device, one embodimentallows the user device to accept an input when the stopping operationhas been applied to the intended AV. In response to the input, theembodiment ceases further applying the stopping operation to the AVsremaining in the set or the reduced subset.

Preferably, the AV should be configured in such a manner that if astopping operation is received at the AV, the AV executes the stoppingoperation only after performing a self-evaluation, which ascertains thata genuinely abnormal circumstance for the stopping operation exists inor with the AV. So, an AV that is operating normally and without anyindication of an abnormal circumstance may ignore a stopping operationreceived by the AV. Some example ways of determining whether an abnormalcircumstance exists is by verifying whether a code or signal ispresented by an onboard data processing system, an occupant isincapacitated according to an onboard sensor, an impact has occurred oris imminent according to a sensor, an unusual force has been applied tothe AV or a part thereof according to a sensor, and many others.

One type of stop command can be configured in such a way that allows anAV to perform a self-evaluation as described herein before decidingwhether the AV will perform the stopping operation according to the stopcommand. Another type of stop command can be configured in such a waythat forces an AV to bypass this type of self-evaluation and force theAV to comply with the stopping operation. This type of forcing might benecessary, for example, when not the AV but another AV in the vicinityis experiencing an abnormal circumstance that justifies stopping allnearby AVs. A stop command can be configured using the presence orabsence of designated codes, formats, values, or some combinationthereof within the command to indicate whether the AV is allowed toperform the self-evaluation before deciding whether the execute thecommand.

One embodiment operating in a server data processing system constructs asuitable stop command according to the circumstance. The embodimenttransmits the stop command to one or more candidate AVs.

Another embodiment operating in a server data processing systemconstructs a suitable stop command authorization according to thecircumstance. The authorization is user device-specific and allows theuser device to transmit the stop command to one or more candidate AVs.In one case, the authorization is also time-limited in that theauthorization is only valid for a pre-determined duration from the timethe authorization is sent to the user device. In another case, theauthorization is also area-limited in that the authorization is onlyvalid for a pre-determined area including the location that was sent inthe request from the user device. In another case, the authorization isalso code-limited in that the authorization is only valid forpre-determined types of stop commands transmittable from the userdevice. One or more of these or other similarly purposed restrictionscan be combined in an authorization within the scope of the illustrativeembodiments.

In one configuration, a server-side embodiment transmits the stopcommand to a candidate AV. In another configuration, a client-sideembodiment transmits the stop command to a candidate AV without anauthorization being required. In another configuration, a server-sideembodiment transmits an authorization to a client-side embodiment, andthe client-side embodiment transmits the stop command to a candidate AVupon valid and suitable authorization. The authorization can bepre-configured in the client-side embodiment, delivered to theclient-side embodiment as an input or transmission, or may be providedas a default for certain types of stop commands.

In one case, a server-side embodiment constructs the stop command andtransmits the stop command to a candidate AV. In another case, aclient-side embodiment constructs the stop command and transmits thestop command to a candidate AV. In another case, a client-sideembodiment constructs the stop command, and the client-side embodimenttransmits the stop command to a candidate AV only upon a valid andsuitable authorization. In another case, a server-side embodimentconstructs the stop command, the server-side embodiment transmits thestop command and optionally an authorization to a client-sideembodiment, and the client-side embodiment transmits the stop command toa candidate AV. In one embodiment, the authorization, the stop command,or both may be transmitted to the client-side embodiment in the sameuser device which transmitted the request with the image and locationinformation.

The manner of public deactivation of autonomous vehicles describedherein is unavailable in the presently available methods. A method of anembodiment described herein, when implemented to execute on a device ordata processing system, comprises substantial advancement of thefunctionality of that device or data processing system in enabling thedevice or data processing system to allow a public user to cause acandidate AV to perform a stopping operation.

The illustrative embodiments are described with respect to certain typesof AVs, circumstances, stopping operations, images, visualcharacteristics, location information, area or radius, commands,authorizations, self-evaluation, sensors, user devices, data processingsystems, environments, components, and applications only as examples.Any specific manifestations of these and other similar artifacts are notintended to be limiting to the invention. Any suitable manifestation ofthese and other similar artifacts can be selected within the scope ofthe illustrative embodiments.

Furthermore, the illustrative embodiments may be implemented withrespect to any type of data, data source, or access to a data sourceover a data network. Any type of data storage device may provide thedata to an embodiment of the invention, either locally at a dataprocessing system or over a data network, within the scope of theinvention. Where an embodiment is described using a mobile device, anytype of data storage device suitable for use with the mobile device mayprovide the data to such embodiment, either locally at the mobile deviceor over a data network, within the scope of the illustrativeembodiments.

The illustrative embodiments are described using specific code, designs,architectures, protocols, layouts, schematics, and tools only asexamples and are not limiting to the illustrative embodiments.Furthermore, the illustrative embodiments are described in someinstances using particular software, tools, and data processingenvironments only as an example for the clarity of the description. Theillustrative embodiments may be used in conjunction with othercomparable or similarly purposed structures, systems, applications, orarchitectures. For example, other comparable mobile devices, structures,systems, applications, or architectures therefor, may be used inconjunction with such embodiment of the invention within the scope ofthe invention. An illustrative embodiment may be implemented inhardware, software, or a combination thereof.

The examples in this disclosure are used only for the clarity of thedescription and are not limiting to the illustrative embodiments.Additional data, operations, actions, tasks, activities, andmanipulations will be conceivable from this disclosure and the same arecontemplated within the scope of the illustrative embodiments.

Any advantages listed herein are only examples and are not intended tobe limiting to the illustrative embodiments. Additional or differentadvantages may be realized by specific illustrative embodiments.Furthermore, a particular illustrative embodiment may have some, all, ornone of the advantages listed above.

With reference to the figures and in particular with reference to FIGS.1 and 2, these figures are example diagrams of data processingenvironments in which illustrative embodiments may be implemented. FIGS.1 and 2 are only examples and are not intended to assert or imply anylimitation with regard to the environments in which differentembodiments may be implemented. A particular implementation may makemany modifications to the depicted environments based on the followingdescription.

FIG. 1 depicts a block diagram of a network of data processing systemsin which illustrative embodiments may be implemented. Data processingenvironment 100 is a network of computers in which the illustrativeembodiments may be implemented. Data processing environment 100 includesnetwork 102. Network 102 is the medium used to provide communicationslinks between various devices and computers connected together withindata processing environment 100. Network 102 may include connections,such as wire, wireless communication links, or fiber optic cables.

Clients or servers are only example roles of certain data processingsystems connected to network 102 and are not intended to exclude otherconfigurations or roles for these data processing systems. Server 104and server 106 couple to network 102 along with storage unit 108.Software applications may execute on any computer in data processingenvironment 100. Clients 110, 112, and 114 are also coupled to network102. A data processing system, such as server 104 or 106, or client 110,112, or 114 may contain data and may have software applications orsoftware tools executing thereon.

Only as an example, and without implying any limitation to sucharchitecture, FIG. 1 depicts certain components that are usable in anexample implementation of an embodiment. For example, servers 104 and106, and clients 110, 112, 114, are depicted as servers and clients onlyas example and not to imply a limitation to a client-serverarchitecture. As another example, an embodiment can be distributedacross several data processing systems and a data network as shown,whereas another embodiment can be implemented on a single dataprocessing system within the scope of the illustrative embodiments. Dataprocessing systems 104, 106, 110, 112, and 114 also represent examplenodes in a cluster, partitions, and other configurations suitable forimplementing an embodiment.

Device 132 is an example of a user device described herein. For example,device 132 can take the form of a smartphone, a tablet computer, alaptop computer, client 110 in a stationary or a portable form, awearable computing device, or any other suitable device. Any softwareapplication described as executing in another data processing system inFIG. 1 can be configured to execute in device 132 in a similar manner.Any data or information stored or produced in another data processingsystem in FIG. 1 can be configured to be stored or produced in device132 in a similar manner.

When applicable in a particular configuration, application 105implements a server-side embodiment described herein. Application 134implements a client-side embodiment described herein. Camera 136 is anexample of an imaging apparatus usable for capturing a visual image ofAV 142. AV 142 is a non-limiting example of AVs described herein. System144 in AV 142 is configured to receive stopping operations, performself-evaluation, execute a suitable stopping operation from a set ofpossible stopping operations based on a circumstance in which thestopping operation is to be executed. Database 109 is a suitablerepository usable to identify and locate an AV as described herein.

Servers 104 and 106, storage unit 108, and clients 110, 112, and 114,and device 132 may couple to network 102 using wired connections,wireless communication protocols, or other suitable data connectivity.Clients 110, 112, and 114 may be, for example, personal computers ornetwork computers.

In the depicted example, server 104 may provide data, such as bootfiles, operating system images, and applications to clients 110, 112,and 114. Clients 110, 112, and 114 may be clients to server 104 in thisexample. Clients 110, 112, 114, or some combination thereof, may includetheir own data, boot files, operating system images, and applications.Data processing environment 100 may include additional servers, clients,and other devices that are not shown.

In the depicted example, data processing environment 100 may be theInternet. Network 102 may represent a collection of networks andgateways that use the Transmission Control Protocol/Internet Protocol(TCP/IP) and other protocols to communicate with one another. At theheart of the Internet is a backbone of data communication links betweenmajor nodes or host computers, including thousands of commercial,governmental, educational, and other computer systems that route dataand messages. Of course, data processing environment 100 also may beimplemented as a number of different types of networks, such as forexample, an intranet, a local area network (LAN), or a wide area network(WAN). FIG. 1 is intended as an example, and not as an architecturallimitation for the different illustrative embodiments.

Among other uses, data processing environment 100 may be used forimplementing a client-server environment in which the illustrativeembodiments may be implemented. A client-server environment enablessoftware applications and data to be distributed across a network suchthat an application functions by using the interactivity between aclient data processing system and a server data processing system. Dataprocessing environment 100 may also employ a service orientedarchitecture where interoperable software components distributed acrossa network may be packaged together as coherent business applications.Data processing environment 100 may also take the form of a cloud, andemploy a cloud computing model of service delivery for enablingconvenient, on-demand network access to a shared pool of configurablecomputing resources (e.g. networks, network bandwidth, servers,processing, memory, storage, applications, virtual machines, andservices) that can be rapidly provisioned and released with minimalmanagement effort or interaction with a provider of the service.

With reference to FIG. 2, this figure depicts a block diagram of a dataprocessing system in which illustrative embodiments may be implemented.Data processing system 200 is an example of a computer, such as servers104 and 106, or clients 110, 112, and 114 in FIG. 1, or another type ofdevice in which computer usable program code or instructionsimplementing the processes may be located for the illustrativeembodiments.

Data processing system 200 is also representative of a data processingsystem or a configuration therein, such as data processing system 132 inFIG. 1 in which computer usable program code or instructionsimplementing the processes of the illustrative embodiments may belocated. Data processing system 200 is described as a computer only asan example, without being limited thereto. Implementations in the formof other devices, such as device 132 in FIG. 1, may modify dataprocessing system 200, such as by adding a touch interface, and eveneliminate certain depicted components from data processing system 200without departing from the general description of the operations andfunctions of data processing system 200 described herein.

In the depicted example, data processing system 200 employs a hubarchitecture including North Bridge and memory controller hub (NB/MCH)202 and South Bridge and input/output (I/O) controller hub (SB/ICH) 204.Processing unit 206, main memory 208, and graphics processor 210 arecoupled to North Bridge and memory controller hub (NB/MCH) 202.Processing unit 206 may contain one or more processors and may beimplemented using one or more heterogeneous processor systems.Processing unit 206 may be a multi-core processor. Graphics processor210 may be coupled to NB/MCH 202 through an accelerated graphics port(AGP) in certain implementations.

In the depicted example, local area network (LAN) adapter 212 is coupledto South Bridge and I/O controller hub (SB/ICH) 204. Audio adapter 216,keyboard and mouse adapter 220, modem 222, read only memory (ROM) 224,universal serial bus (USB) and other ports 232, and PCI/PCIe devices 234are coupled to South Bridge and I/O controller hub 204 through bus 238.Hard disk drive (HDD) or solid-state drive (SSD) 226 and CD-ROM 230 arecoupled to South Bridge and I/O controller hub 204 through bus 240.PCI/PCIe devices 234 may include, for example, Ethernet adapters, add-incards, and PC cards for notebook computers. PCI uses a card buscontroller, while PCIe does not. ROM 224 may be, for example, a flashbinary input/output system (BIOS). Hard disk drive 226 and CD-ROM 230may use, for example, an integrated drive electronics (IDE), serialadvanced technology attachment (SATA) interface, or variants such asexternal-SATA (eSATA) and micro-SATA (mSATA). A super I/O (SIO) device236 may be coupled to South Bridge and I/O controller hub (SB/ICH) 204through bus 238.

Memories, such as main memory 208, ROM 224, or flash memory (not shown),are some examples of computer usable storage devices. Hard disk drive orsolid state drive 226, CD-ROM 230, and other similarly usable devicesare some examples of computer usable storage devices including acomputer usable storage medium.

An operating system runs on processing unit 206. The operating systemcoordinates and provides control of various components within dataprocessing system 200 in FIG. 2. The operating system may be acommercially available operating system for any type of computingplatform, including but not limited to server systems, personalcomputers, and mobile devices. An object oriented or other type ofprogramming system may operate in conjunction with the operating systemand provide calls to the operating system from programs or applicationsexecuting on data processing system 200.

Instructions for the operating system, the object-oriented programmingsystem, and applications or programs, such as application 105 and/orapplication 134 in FIG. 1, are located on storage devices, such as inthe form of code 226A on hard disk drive 226, and may be loaded into atleast one of one or more memories, such as main memory 208, forexecution by processing unit 206. The processes of the illustrativeembodiments may be performed by processing unit 206 using computerimplemented instructions, which may be located in a memory, such as, forexample, main memory 208, read only memory 224, or in one or moreperipheral devices.

Furthermore, in one case, code 226A may be downloaded over network 201Afrom remote system 201B, where similar code 201C is stored on a storagedevice 201D. in another case, code 226A may be downloaded over network201A to remote system 201B, where downloaded code 201C is stored on astorage device 201D.

The hardware in FIGS. 1-2 may vary depending on the implementation.Other internal hardware or peripheral devices, such as flash memory,equivalent non-volatile memory, or optical disk drives and the like, maybe used in addition to or in place of the hardware depicted in FIGS.1-2. In addition, the processes of the illustrative embodiments may beapplied to a multiprocessor data processing system.

In some illustrative examples, data processing system 200 may be aportable computing or communication device, which is generallyconfigured with flash memory to provide non-volatile memory for storingoperating system files and/or user-generated data. A bus system maycomprise one or more buses, such as a system bus, an I/O bus, and a PCIbus. Of course, the bus system may be implemented using any type ofcommunications fabric or architecture that provides for a transfer ofdata between different components or devices attached to the fabric orarchitecture.

A communications unit may include one or more devices used to transmitand receive data, such as a modem or a network adapter. A memory may be,for example, main memory 208 or a cache, such as the cache found inNorth Bridge and memory controller hub 202. A processing unit mayinclude one or more processors or CPUs.

The depicted examples in FIGS. 1-2 and above-described examples are notmeant to imply architectural limitations. For example, data processingsystem 200 also may be a tablet computer, laptop computer, or telephonedevice in addition to taking the form of a mobile or wearable device.

Where a computer or data processing system is described as a virtualmachine, a virtual device, or a virtual component, the virtual machine,virtual device, or the virtual component operates in the manner of dataprocessing system 200 using virtualized manifestation of some or allcomponents depicted in data processing system 200. For example, in avirtual machine, virtual device, or virtual component, processing unit206 is manifested as a virtualized instance of all or some number ofhardware processing units 206 available in a host data processingsystem, main memory 208 is manifested as a virtualized instance of allor some portion of main memory 208 that may be available in the hostdata processing system, and disk 226 is manifested as a virtualizedinstance of all or some portion of disk 226 that may be available in thehost data processing system. The host data processing system in suchcases is represented by data processing system 200.

With reference to FIG. 3, this figure depicts a block diagram of anexample configuration for public deactivation of autonomous vehicles inaccordance with an illustrative embodiment. Configuration 300 uses anon-limiting client-server configuration employing a client-sideembodiment and a server-side embodiment. Application 302 is an exampleof application 134 in FIG. 1. Application 304 is an example ofapplication 105 in FIG. 1. Database 306 is an example of database 109 inFIG. 1. AV 308 is an example of AV 142 in FIG. 1. Camera 310 is anexample of imaging apparatus 136 in FIG. 1.

Camera 310 is located at a geographical location. As an example, supposethat a user device (not shown) in which camera 310 and application 302are operating computes location information 312. Camera 310 captureimage 314 of AV 308 from location 314 and sends image 314 to application302.

In the depicted configuration, application 302 sends location 312 andimage 314 to application 304. Application 304 extracts a set of visualcharacteristics of AV 308 from image 314. Application 304 sends query316 to database 306. Query 316 includes one or more visualcharacteristics of image 314 and location 312.

Optionally, query 316 also includes a radius or another type of areadefinition to be used from location 312. In one embodiment, database 306uses a default radius. Optionally, query 316 also includes a time of AVoperation to be used from location 312. In one embodiment, database 306uses the time the query is received (adjusted by an optional time toaccount for transmission delays) as a default time of AV operation.

Database 306 returns a set of AVs operating in the area defined bylocation 312 and the radius or other area definition, during a periodincluding the time, and having the specified visual characteristic(s).Application 304 identifies from the set of AVs, a subset of candidateAVs. The subset of candidate AVs includes AV 308. Application 304 sendsstop command 318 to AV 308.

System 144 computes the location of AV 308 from time to time and keepsthe location of AV 308 current in database 306 within the specifiedrecency requirement of database 306. System 144 in AV 308 receives stopcommand 318. System 144 may, but need not necessarily, perform aself-evaluation under certain circumstances before electing to execute,or executing, stop command 318.

In an alternate configuration (not shown), application 302 performs theoperations described with respect to application 304. In such aconfiguration, application 304 may not exist at all, or may implementonly that functionality which is not implemented in application 302 forimplementation-specific reasons.

With reference to FIG. 4, this figure depicts another exampleconfiguration for public deactivation of autonomous vehicles inaccordance with an illustrative embodiment. In configuration 400,elements 144, 306, 308, 312, 314, and 316 are the same and operate inthe same manner as in the configuration of FIG. 3.

In the depicted configuration, application 402 sends location 312 andimage 314 to application 404. Application 404 extracts a set of visualcharacteristics of AV 308 from image 314. Application 404 sends query316 to database 306. Database 306 returns a set of AVs to application404. Application 404 identifies from the set of AVs, a subset ofcandidate AVs. The subset of candidate AVs includes AV 308.

In configuration 400, application 404 sends authorization 406 toapplication 402. Application 402 constructs stop command 408 accordingto authorization 406. Application 402 sends command 408 to AV 308.System 144 in AV 308 operates on stop command 408 in a manner similar tocommand 318 in FIG. 3.

In an alternate configuration (not shown), authorization 406 may alsoinclude stop command 408 or a variation thereof. In such aconfiguration, application 402 either transmits the received stopcommand or modifies the received stop command to form command 408 andtransmits command 408 as described herein.

In another alternate configuration (not shown), application 402 performsthe operations described with respect to application 404. In such aconfiguration, application 404 may not exist at all, or may implementonly an authorization functionality for authorizing application 402, asdescribed herein.

With reference to FIG. 5, this figure depicts one example configurationof an application for public deactivation of autonomous vehicles inaccordance with an illustrative embodiment. Application 502 is anexample of application 302 in FIG. 3 or 402 in FIG. 4.

Component 504 capture an image of an AV that is to be stopped. Forexample, component 504 uses camera 310 to capture image 314 of AV 308,as in FIGS. 3 and 4.

Component 506 transmits a location and the image to a server-sideapplication 602 in FIG. 6, when application 602 is implemented on aserver data processing system. The location can be captured in anysuitable manner, e.g., using a GPS module of a user device whereapplication 502 may be executing.

When an authorization mechanism is implemented, component 508 receivesan authorization to perform a stopping operation on a candidate AV inthe image. Component 510 configures a stop command. When a stop commandis also received with the authorization, component 510 adapts or altersthe received stop command as may be needed in a given implementation.

Component 512 transmits the stop command to the candidate AV. Components508, 510, and 512 operate when the stop command to a candidate AV flowsto the candidate AV through application 502.

With reference to FIG. 6, this figure depicts another exampleconfiguration of an application for public deactivation of autonomousvehicles in accordance with an illustrative embodiment. Application 602is an example of application 304 in FIG. 3 or 404 in FIG. 4. Animplementation can elect to implement some or all of the functionsdescribed in application 602, in application 502 of FIG. 5.

Component 604 verifies that the sender of the request, e.g., application502 of FIG. 5 or a user associated therewith, is authorized to, or atleast not prevented from, causing an AV to perform a stopping operation.For example, there may exist a blacklist of persons or devices that areknown to be malicious for some reasons, and who should not be trusted tocause stopping operations on AVs.

Component 606 verifies the integrity of the location information in therequest, e.g., to determine if the location is spoofed or modified.Component 606 also performs the corroboration function using externaldata and/or a request from another public user as described herein.

Component 608 locate a set of AVs operating in an area including thelocation in the request. For example, component 608 constructs query 316and interacts with database 306 to obtain the information about the setof AVs. Component 610 selects a subset of the AVs based on a visualcharacteristic or other verification operation as described earlier.

When application 602 is configured to send the stop commands, component612 configures a stop command for a candidate AV in the subset. Whenapplication 502 of FIG. 5 is configured to send the stop commands,component 612 configures a stop authorization for application 502. Insome implementation, component 612 may construct the stop command andthe stop authorization for sending to application 502 as describedherein.

When application 602 is configured to send the stop commands tocandidate AVs, component 614 transmits the stop command to a candidateAV. When application 602 is configured to send the stop authorization toapplication 502, component 614 transmits the stop authorization toapplication 502. When application 602 is configured to send the stopcommands to application 502, component 614 transmits the stop command toapplication 502.

With reference to FIG. 7, this figure depicts a flowchart of an exampleprocess for public deactivation of autonomous vehicles in accordancewith an illustrative embodiment. Process 700 can be implemented entirelyin a combined implementation of applications 502 and 602, or bedistributed across application 502 and application 602 when theapplications are implemented separately.

An application captures a visual image of an AV (block 702). Theapplication associated the image of the AV with a location of theimaging apparatus (block 704).

The application optionally verifies the sending public user's identity,sending user device's identity, integrity of the location data, or acombination thereof (block 706). The application locates a set of AVsoperating in an area relative to the location (block 708). Theapplication performs image analysis on the captured image to select asubset of AVs that match at least one visual characteristic extractedfrom the image (block 710).

When multiple matches exist in the set of AVs (“Yes” path of block 712),the application determines whether all matching AVs are candidates andshould be send stopping operations (block 714). When a single match isfound in the set of AVs (“No” path of block 712), the applicationproceeds to block 720.

When not all candidate AVs are to perform the stopping operations (“No”path of block 714), the application performs one or both of twooptions—the application selects the best match from the subset ofcandidate AVs (block 716). Alternatively, or together with block 716,the application requests, collects, or verifies additional visualcharacteristics of the AV desired to be stopped (block 718). Theapplication proceeds to block 716 to find the best match with theadditional characteristic.

Once the best matching AV has been selected at block 716, or all AVs inthe set are to be stopped, the application determines whether the stopcommand is to be sent via the user device (block 720). If the userdevice is to send the stop command to a candidate AV (“Yes” path ofblock 720, the application optionally constructs a stop authorizationfor the user device (block 722). The authorization causes the userdevice to construct a stop command as described herein.

If the stop command is not to be transmitted from the user device (“No”path of block 720), the application constructs the stop command (block724). The application transmits the stop command to one or morecandidate AVs, as the case may be (block 726). The transmission causesan AV to execute a stopping operation (block 728). The application endsprocess 700 thereafter.

Thus, a computer implemented method, system or apparatus, and computerprogram product are provided in the illustrative embodiments for publicdeactivation of autonomous vehicles and other related features,functions, or operations. Where an embodiment or a portion thereof isdescribed with respect to a type of device, the computer implementedmethod, system or apparatus, the computer program product, or a portionthereof, are adapted or configured for use with a suitable andcomparable manifestation of that type of device.

Where an embodiment is described as implemented in an application, thedelivery of the application in a Software as a Service (SaaS) model iscontemplated within the scope of the illustrative embodiments. In a SaaSmodel, the capability of the application implementing an embodiment isprovided to a user by executing the application in a cloudinfrastructure. The user can access the application using a variety ofclient devices through a thin client interface such as a web browser(e.g., web-based e-mail), or other light-weight client-applications. Theuser does not manage or control the underlying cloud infrastructureincluding the network, servers, operating systems, or the storage of thecloud infrastructure. In some cases, the user may not even manage orcontrol the capabilities of the SaaS application. In some other cases,the SaaS implementation of the application may permit a possibleexception of limited user-specific application configuration settings.

The present invention may be a system, a method, and/or a computerprogram product at any possible technical detail level of integration.The computer program product may include a computer readable storagemedium (or media) having computer readable program instructions thereonfor causing a processor to carry out aspects of the present invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, including but not limited tocomputer-readable storage devices as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, configuration data for integrated circuitry, oreither source code or object code written in any combination of one ormore programming languages, including an object oriented programminglanguage such as Smalltalk, C++, or the like, and procedural programminglanguages, such as the “C” programming language or similar programminglanguages. The computer readable program instructions may executeentirely on the user's computer, partly on the user's computer, as astand-alone software package, partly on the user's computer and partlyon a remote computer or entirely on the remote computer or server. Inthe latter scenario, the remote computer may be connected to the user'scomputer through any type of network, including a local area network(LAN) or a wide area network (WAN), or the connection may be made to anexternal computer (for example, through the Internet using an InternetService Provider). In some embodiments, electronic circuitry including,for example, programmable logic circuitry, field-programmable gatearrays (FPGA), or programmable logic arrays (PLA) may execute thecomputer readable program instructions by utilizing state information ofthe computer readable program instructions to personalize the electroniccircuitry, in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general-purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein comprises anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the blocks may occur out of theorder noted in the Figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

1. A method comprising: capturing using an imaging capability of a userdevice associated with a public user, an image of an autonomous vehicle(AV) operating in an area, wherein the public user associated with theuser device is other than an occupant or controller of the AV and theuser device is disassociated from the AV; performing image processing ofthe image of the AV to extract a set of visual characteristics of theAV, wherein a visual characteristic in the set of visual characteristicsis insufficient to uniquely identify the AV; selecting from a set of AVsa subset of candidate AVs, wherein each candidate AV in the subset ofcandidate AVs matches within a tolerance at least one visualcharacteristic in the set of visual characteristics, the subset ofcandidate AVs including the AV; sending a stop command to the AV, thesending causing the AV to execute a stopping operation resulting in adecrease in a speed of the AV.
 2. The method of claim 1, furthercomprising: authorizing the user device to transmit the stop command tothe AV, wherein the authorizing is specifically for the user device. 3.The method of claim 2, further comprising: constructing the stop commandat the user device, wherein the sending the stop command to the AV isperformed by the user device.
 4. The method of claim 1, furthercomprising: sending the stop command to each candidate AV in the subsetof candidate AVs, wherein the stop command causes each candidate AV toperform a corresponding sequence of operations.
 5. The method of claim4, further comprising: causing at a first candidate AV, aself-evaluation, as a part of a sequence of operation corresponding tothe first candidate AV, the self-evaluation determining whether thefirst candidate AV has an indication of an abnormal circumstance; andcausing, responsive to a negative indication, the first candidate AV toignore the stop command.
 6. The method of claim 5, further comprising:causing at a second candidate AV, a second self-evaluation, as a part ofa second sequence of operation corresponding to the second candidate AV,the second self-evaluation determining whether the second candidate AVhas a second indication of a second abnormal circumstance; and causing,responsive to a positive indication, the second candidate AV to executea second stopping operation corresponding to the stop command.
 7. Themethod of claim 4, further comprising: causing at a first candidate AV,an omission a self-evaluation in a sequence of operation correspondingto the first candidate AV, the omission resulting from the stop commandhaving a type configured to cause the omission, the type being selectedfrom the group consisting of designated codes, formats, values, or anycombination thereof; and causing, responsive to the omission, the firstcandidate AV to execute a first stopping operation corresponding to thestop command.
 8. The method of claim 1, further comprising: sending fromthe user device a request to cause the AV to perform the stoppingoperation at the AV, the request comprising the image and a location ofthe user device.
 9. The method of claim 8, further comprising:validating, prior to sending the request, that the user device and thepublic user are not prevented from causing the AV to perform thestopping operation.
 10. The method of claim 8, further comprising:validating, prior to sending the request, that a location of the userdevice has not been spoofed.
 11. The method of claim 8, furthercomprising: causing a delay between the public user inputting therequest at the user device and sending the request from the user device.12. The method of claim 1, further comprising: computing, at a time ofcapturing the image, a location of the user device; and defining thearea as a polygon enclosing the location of the user device.
 13. Themethod of claim 1, further comprising: identifying the set of AVsoperating in the area at a time when the image was captured, wherein theidentifying the set of AVs is responsive to querying a repository oflocation information corresponding to a superset of operational AVs, thequerying selecting the set of AVs from the superset based on a locationof the user device.
 14. The method of claim 13, wherein the queryingfurther selects the set of AVs from the superset based on a first visualcharacteristic from the set of visual characteristics.
 15. The method ofclaim 1, wherein the AV comprises one of an autonomously operatingautomobile, an autonomously operating robotic entity, and anautonomously operating drone.
 16. The method of claim 1, wherein thevisual characteristic comprises one of a color of the AV, a model of theAV, a number of appendages of the AV, and a type of an appendage of theAV.
 17. A computer usable program product comprising one or morecomputer-readable storage devices, and program instructions stored on atleast one of the one or more storage devices, the stored programinstructions comprising: program instructions to capture using animaging capability of a user device associated with a public user, animage of an autonomous vehicle (AV) operating in an area, wherein thepublic user associated with the user device is other than an occupant orcontroller of the AV and the user device is disassociated from the AV;program instructions to perform image processing of the image of the AVto extract a set of visual characteristics of the AV, wherein a visualcharacteristic in the set of visual characteristics is insufficient touniquely identify the AV; program instructions to select from a set ofAVs a subset of candidate AVs, wherein each candidate AV in the subsetof candidate AVs matches within a tolerance at least one visualcharacteristic in the set of visual characteristics, the subset ofcandidate AVs including the AV; program instructions to cause the AV toexecute a stopping operation by sending a stop command to the AV, thestopping operation resulting in a decrease in a speed of the AV.
 18. Thecomputer usable program product of claim 17, wherein the computer usablecode is stored in a computer readable storage device in a dataprocessing system, and wherein the computer usable code is transferredover a network from a remote data processing system.
 19. The computerusable program product of claim 17, wherein the computer usable code isstored in a computer readable storage device in a server data processingsystem, and wherein the computer usable code is downloaded over anetwork to a remote data processing system for use in a computerreadable storage device associated with the remote data processingsystem.
 20. A computer system comprising one or more processors, one ormore computer-readable memories, and one or more computer-readablestorage devices, and program instructions stored on at least one of theone or more storage devices for execution by at least one of the one ormore processors via at least one of the one or more memories, the storedprogram instructions comprising: program instructions to capture usingan imaging capability of a user device associated with a public user, animage of an autonomous vehicle (AV) operating in an area, wherein thepublic user associated with the user device is other than an occupant orcontroller of the AV and the user device is disassociated from the AV;program instructions to perform image processing of the image of the AVto extract a set of visual characteristics of the AV, wherein a visualcharacteristic in the set of visual characteristics is insufficient touniquely identify the AV; program instructions to select from a set ofAVs a subset of candidate AVs, wherein each candidate AV in the subsetof candidate AVs matches within a tolerance at least one visualcharacteristic in the set of visual characteristics, the subset ofcandidate AVs including the AV; program instructions to cause the AV toexecute a stopping operation by sending a stop command to the AV, thestopping operation resulting in a decrease in a speed of the AV.